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ABSTRACT 

experimental  study  to  compare  the  simplex  method  and 
the  lemke'a  method  to  solve  linear  programs  is  made.  The 
M3  code  for  simplex  method  and  the  author's  code  for  the 
Lemke  method  were  used  in  the  study.  Comparison  was  made 
only  with  regard  to  the  number  of  iterations  each  method 
takes  and  our  little  study  shows  encouraging  results  about 
the  superiority  of  Lemke  method,  but  no  general  recommenda¬ 
tion  la  made  by  the  author  due  to  size  of  the  study  and 
data.  A  by-product  of  our  study  is  a  complementary  pivot 
algorithm  to  solve  linear  programs  which  is  a  modification 
of  the  Lemke' s  method  and  which  saves  a  considerable  storage 
and  time  of  computation. 


AN  EXPERIMENTAL  STUDY  ON  SOLVING  LINEAR  PROGRAMS 

by 

A.  Ravindran 

1.  INTP  AUCTION 

From  the  beginning  of  the  era  of  linear  programming  a  lot  of  work  has  been 
done  to  find  a  better  and  more  efficient  method  to  solve  linear  programs  than 
the  simplex  method  of  G.  B.  Dantzig  [1]  but  without  much  success.  Quite  a  few 
papers  have  been  published  about  the  performance  of  the  simplex  method  in  terms 
of  the  number  of  iterations  or  pivot  steps.  Kuhn  and  Quandt  made  a  study  to 
test  different  pivot  choices  for  the  simplex  code  [4];  but  strangely,  the  firm 
theoretical  bounds  given  in  the  papers  are  much  higher  than  the  actual  number 
encountered  in  practice.  In  apite  of  extensive  computational  experience,  not 
very  much  is  known  precisely  about  the  performance  of  the  simplex  method,  and 
it  is  still  considered  to  be  the  best  known  method  to  solve  linear  programs  by 
many  workers  in  the  field. 

To  add  to  this  huge  amount  of  literature  on  the  study  of  the  simplex 
method,  we  have  made  a  small  scale  study  to  compare  it  with  the  "complementary 
pivotal  method"  of  Lemke  and  Howson.  Our  main  object  has  been  to  compare  the 
number  of  iterations  in  both  cases.  Our  study  revealed  that  generally  Lemke 
method  is  as  efficient  as  simplex  and  in  special  class  of  A  matrices 
(viz  A  >  0)  Lemke  method  takes  as  little  as  1/2  to  1/3  the  number  of  iterations 
of  simplex!  This  opens  the  door  to  further  study  of  the  Lemke  method  on  a  large 
scale  to  solve  linear  programs.  A  by-product  of  our  study  is  a  modified 
algorithm  to  that  of  Lemke-Howson  to  solve  linear  programs  which  will  save  a 
considerable  amount  of  storage  and  computation  time. 
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To  make  this  account  self-contained,  an  exposition  of  the  Lemke's  method 
in  the  form  we  have  used  (i.e.,  programmed*)  is  presented  in  Section  2.  The 
details  of  the  statistical  experiment  and  the  results  of  our  study  are  described 
In  Section  3.  Our  modified  Lemke's  algorithm  is  explained  in  Section  4. 

The  fact  that  led  us  to  make  this  study  is  that  the  simplex  method  always 
■tarts  with  a  basic  feasible  solution  [1].  In  many  problems  in  fact  we  do  not 
have  an  initial  basic  feasible  solution  readily  available  and  to  find  one, 
one  uses  the  so  called  Phase  1  technique  of  Dantzig  which  means  solving  another 
linear  program  with  additional  artificial  variables.  This  Phase  1  is  avoided 
when  one  uses  Lemke  method  as  it  is  easy  to  find  one  "almost  complementary 
solution. " 


*An  independent  computer  program  was  written  in  FORTRAN  IV  for  the  Lemke-Howson' s 
algorithm  by  the  author. 


3 


2 .  THF.  COMPLEMENTARY  PROBLEM  AND  LEMKE' S  ITERATIVE  TECHNIQUE 


The  following  complementary  problem  was  posed  by  Dantzlg  and  Cottle  in 


1963  [2] 


w  ■  Mz  +  q 

w  >  0,  z  >  0  (1)* 

m  m 

wz  -  0  (i.e. ,  w^z^  "  0) 

where  M  is  (n  x  n)  square  matrix. 

v,z,q  are  n-vectors. 

It  can  be  seen  that  linear  programming,  quadratic  programming  and  bi-matrix 
(2-person,  nonzero-sum)  games  can  be  transformed  to  the  above  complementary 
problem  form. 

Dantzlg  and  Cottle  In  their  paper  [2]  also  proposed  an  algorithm  which  is 
applicable  to  matrices  M  that  have  positive  principal  minors  (in  particular  to 
positive  definite  matrices)  and  after  some  modification  (which  uses  the  notion 
of  "block  pivot")  to  positive  semi-definite  matrices.  But  we  will  be  concerned 
with  the  iterative  technique  of  Lemke  and  Howson  [4]  for  finding  equilibrium 
points  of  bi-matrix  games  which  was  later  extended  by  Lemke  [3]  to  the  complementary 
problem  (1).  We  will  essentially  give  the  step  by  step  procedure  of  the  Lemke 's 
algorithm  as  presented  by  Gale  [3]  which  is  also  used  as  the  basis  for  the 
computer  code  written. 

Consider  the  following  linear  program: 

Minimize  cx 

Subject  to  Ax  >  b  (2) 

x  >  0 

m 

No  special  notation  to  denote  the  transpose  of  a  vector  is  used  throughout  this  paper. 
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Let  A  be  o  x  n  matrix,  b  is  en  m-vector,  c  and  x  are  n-vectora. 

The  above  problem  can  be  transformed  into  a  complementary  problem  very 
easily  as  follows: 


uy  +  vx  ■  0 
x.y.u.v  >  0 


where  u-denotes  the  primal  slack  variables 
y-denotes  the  dual  variables 
v-denotes  the  dual  slack  variables. 

The  reader  will  immediately  note  that  system  (3)  represents  primal  and 
dual  feasibility  and  (4)  represents  the  complementary  slackness  condition. 
Comparing  these  to  system  (1)  will  show 


M 


■  [.:■  :]•  •  •  o  ■  ■ ■  O' •  ■ ■  o  - 


(3) 


(4) 


It  should  b'.>  remarked  here  that  M  is  a  square  nonsymmetrlc  positive  semi- 
definite  matrix  of  order  m  +  n  . 

We  shall  now  describe  Lemke's  method  to  solve  the  original  complementary 
problem  (1)  which  guarantees  to  terminate  with  a  solution  if  it  exists  for  the 
following  cases:  (i)  M  >  0  (all  elements),  (li)  M  is  positive  definite, 
(Hi)  M  having  positive  principal  determinants,  (lv)  M  is  positive  semi- 
definite,  (v)  M  co-positive.  We  shall  first  start  with  some  definitions. 

Let  a. . a  denote  the  first  n-column  vectors  of  M  matrix,  e, ,  ...,  e 

are  the  first  n  unit  vectors. 
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Definition  1:  Complementary  Solution 

A  solution  (w,z)  >  0  satisfying  w  -  M2  +  q  and  for  each  1  ■  1,  n 

either  e^  (<=>variable  w^)  or  -a^  (<=>varlable  is  in  the  basis  and  not 

both,  i.c.,  a  solution  to  system  (1). 

Definition  2:  Almost  Complementary  Solution 

A  solution  (w,z)  >  0,  Zq  >  0  to  the  system  w»Mz+eZo+q  where 

e  ■  (1 . 1)  such  that  exactly  for  one  1  both  e  and  -a.  are  out  of 

(lxn)  1  1 

the  basis;  and  of  course  Z  Is  in  the  basis  as  Z  >  0  . 

o  o 

Lemke' z  algorithm  starts  with  an  almost  complementary  solution  by  adding 
the  vector  e  Zq  to  w  ■  Mz  +  q  and  using  a  complementary  pivot  rule  (described 
later)  moves  from  one  almost  complementary  solution  to  the  other  until  it 
terminates  which  is  given  by  the  termination  conditions  described  later. 

The  initial  almost  complementary  solution  is  found  by  augmenting  the  vector 
e  Zq  to  the  system  (1)  as  follows: 

w-MZ-eZ  -  q 
o  ^ 

w,z,Z  >  0 
’  ’  o  - 

w*z  •  0  . 

The  Initial  tableau  with  respect  to  the  unit  basis  will  be  as  follows: 


Basis 

Vectors* 

V 

C«)f  •••»  6-i  •••»  ®_ 

i  s  n 

“4^  •  •  • 

•  •  •  —ft 

n 

-e 

q 

*1 

1 

-m^ ^  • •  • 

"mln 

-1 

qi 

• 

1 

"°21 

*•*  ”°2n 

-1 

• 

• 

q2 

e 

•  9 
• 

1 

—ID  ,  •  •  • 

si 

•  •  •  —ID 

an 

-1 

• 

• 

qs 

e 

n 

1 

-m  ,  .  ■ . 
nl 

•  •  •  —ID 

an 

-1 

qn 

TABLE  1 
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Note  that  the  initial  basis  though  complementary  need  not  be  feasible  as  some 
qA  <  0  . 

Step  1: 

-e  vector  (variable  Zq)  is  brought  into  the  basii  so  as  to  replace  one 

of  e  's  ,  namely,  «*  from  the  basis  where  q  -  Min  (q.)  .  If 

i«l,2, . . ,n 

q^  >  0  then  terminate.  We  have  a  complementary  solution  to  (1)  given  by 
■  q^  and  ■  0  .  Otherwise  perform  the  pivot  as  shown  below  with 
circled  element  as  pivot  element. 

The  pivot  operation  yields  the  following  tableau 


i  i 


where 

qs  "  *V  qi  "  qi 

-  q  V  i  +  s 
~  8 

*  ~®_j 

B  .  -  ~  i  -  O  . 

sj  -1  sj 

c 

CM 

H 

1 

> 

"ij  ■  "miJ  +  °sj 

^  J  m  1*2 . n 

Vi  j*  s  . 

qi 


Note 


> 


0  Vi  . 
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»  lit 

l’Z0  "  Wl  "  q8+l . 

1 

w  •  q  ,  is  an  almost  complementary  solution  as  both  variables  w  and  z  are 
n  nn  r  j  §  s 

out  of  the  basis,  Z  >0  and  w,z  >  0  . 


The  corresponding  basic  solution 


W1  " 


*1* 


w  ,  -  q 
s-l  s- 


Step  2: 

Since  both  the  vectors  -a  and  e  are  out  of  the  basis,  we  bring  in  -a 

8  8  °  i 

into  the  basis  which  will  still  maintain  almost  complementarity.  To  find  the 
vector  leaving  the  basis,  form  the  ratios 


— T~  for  i  -  1, 


n  and 


m 


m.  >0 

is 


V  i  -  1 . n 


is 


Let 


Min 


m 


is>0 


m 


is 


then 


I 


\s 


w.  leaves  the  basis, 
k 

as  the  pivot  element. 


Obtain  the  new  tableau  by  performing  the  pivot  with 


Step  3: 

Now  bring  in  -a^  into  the  basis  and  continue  as  before  until  one  of  the 
two  things  happen  which  indicates  termination. 

(i)  Min  ratio  happens  at  the  s^  row  and  Zq  leaves  the  basis.  The 
resulting  basic  solution  (after  the  pivot)  is  the  complementary  solution 
to  (1). 

(ii)  All  m^  for  i  ■  1,2,  ...,  n  are  <  0  =£>  there  exists  no  feasible 
solution  to  the  original  problem  (1). 

In  the  coding  of  the  algorithm  there  was  a  slight  modification  done.  Instead 


of  doing  the  pivot  operation  to  the  whole  tableau  only  the  inverse  of  the  basis 
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is  kept  In  the  memory  and  the  pivot  operations  were  done  only  to  the  inverse. 
Similar  ideas  that  are  common  in  revised  simplex  method  with  explicit  inverse  are 
employed . 
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3.  DESIGN,  DATA  AND  RESULTS  OF  THE  EXPERIMENT 

In  order  to  evaluate  the  statistical  efficiency  of  the  simplex  method  and 
Lemke's  method  in  solving  linear  programs,  a  number  of  linear  programs  were 
generated  randomly  and  the  solutions  computed^  by  both  methods.  The  linear 
programs  generated  were  of  the  form;  Ax  >  b,  x  >  0  minimize  c-x  .  Elements  of 
matrix  A  ,  vectors  b  and  c  were  chosen  randomly  from  a  uniform  distribution 
from  0  and  1.  Matrices  of  size  5x5,  10  x  10,  15  x  15  were  tried  for  the  A 
matrix.  Initially,  10  problems  for  each  size  were  generated  and  for  each  problem 
and  method  the  number  of  iterations  and  the  means  of  iteration  count  for  each 
size  matrix  are  noted.  They  are  shown  in  the  following  tables. 


The  calculations  were  done  on  the  IBM-7094  at  the  Computer  Center,  University  of 
California',  Berkeley.  The  M3  code  was  used  for  the  simplex  method  and  the  author's 
code  for  the  Lemke  method. 
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Results  of  the  Study 


SIZE  5  x  5(A  >  0)  SIZE  10  x  10(A  >  0) 


No.  of  Iterations 

No.  of  Iterations 

Prob. 

No. 

Simplex 

Method 

Lemke 

Method 

Comment 

Prob. 

No. 

Simplex 

Lemke 

Comment 

1 

14 

3 

Optimal  Sol. 

1 

25 

9 

Optimal  Sol. 

2 

10 

7 

II 

2 

28 

9 

II 

3 

10 

11 

It 

3 

29 

9 

II 

4 

14 

7 

II 

4 

29 

15 

II 

5 

11 

5 

•  1 

5 

24 

13 

II 

6 

11 

7 

1  II 

6 

27 

17 

II 

7 

9 

5 

|  II 

7 

23 

13 

II 

8 

12 

5 

II 

8 

33 

7 

II 

9 

10 

9 

II 

25 

11 

II 

10 

12 

15 

II 

26 

15 

II 

Average 

11.3 

7.4 

Simplex 

Average 

26.9 

11.8 

Simplex 

1»j2"  _  «  [ 

Lemke 

t,‘/"  Lemke 

SIZE  15  x  15(A  > 

0) 

Prob. 

No. 

Simplex 

Lemke 

Comment 

Prob. 

No. 

Simplex 

Lemke 

Comment 

1 

48 

13 

Optimal 

1 

22 

41 

Optimal 

2 

48 

15 

It 

2 

33 

27 

Optimal 

3 

52 

17 

II 

3 

22 

13 

Infeasible 

4 

47 

15 

II 

4 

30 

’•1 

Optimal 

5 

57 

13 

It 

5 

35 

33 

Optimal 

6 

43 

11 

II 

6 

21 

18 

Infeasible 

7 

49 

17 

II 

7 

14 

17 

Infeasible 

8 

46 

23 

II 

8 

30 

31 

Infeasible 

9 

45 

21 

ii 

9 

24 

27 

Infeasible 

10 

46 

21 

II 

33 

35 

Infeasible 

Average 

48.1 

16.6 

48.1  „  nQ 

Average 

26.4 

27.3 

26.4 

16.6  2,89  1 

27.3  "  -96 

SIZE  (15  x  15) 


80%  of  A  -  0 


Prob. 

No. 


'  A  20*  of  A  >  0 


No.  of  Iterations 
- ! 

Simplex  j  Lemke  Comment 


Prob. 

No. 


80*  of  A  -  0 
SIZE  (15  x  15)  10*  of  A  >  0 
10*  of  A  <  0 


No.  of  Iterations 
Simplex  [  Lemke  Comment 
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Discussion  of  the  Results 

The  previous  tables  show  when  the  matrix  A  was  positive,  the  simplex 
method  takes  1.52  times  for  5x5,  2.27  times  for  10  x  10  and  2.89  times  for  15  x  15 
more  number  of  iterationt,  compared  to  Lemke  method  and  hence  Lemke  method  seems 
more  efficient  in  the  number  of  iterations.  The  best  reason  may  be  that  the 
Lemke  method  avoids  the  Phase  1  procedure  of  simplex  method  and  for  A  >  0  it  is 
possible  to  get  an  easy  feasible  solution  to  the  primal  even  if  we  do  not  use 
simplex  Phase  1.  During  our  discussions  with  Dantzig  [7]  it  was  suggested  that 
we  should  try  some  matrices  with  a  lot  of  zero  entries.  And  even  in  that  excepting 
50X  positive  and  negative  entries  of  A  matrix,  .  n  all  the  other  cases,  Lemke 
method  appears  to  be  more  efficient  even  in  finding  a  basic  feasible  solution 
compared  to  Phase  1  procedure.  Since  the  research  was  directed  at  one  aspect  of 
the  methods  (viz  No.  of  iterations)  and  the  data  are  based  on  the  statistics  of 
one  class  of  linear  programs,  we  do  not  make  any  conclusive  recommendation 
about  the  efficiency  of  either  method  for  solving  linear  programs.  But  our  little 
study  has  evidently  shown  that  the  results  we  have  are  very  encouraging  to  do  a 
large  scale  study  about  these  two  methods  for  future  investigation. 
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4.  A  MODIFIED  APPROACH  TO  SOLVE  LINEAR  PROGRAMS  BY  LEMKF.'S  METHOD 

We  observed  In  Section  3  that  when  the  A  matrix  is  strictly  positive,  it 
is  worthwhile  solving  the  linear  program  by  Lemke  method  and  in  other  classes  of 
A  matrices  both  methods  are  equally  good.  The  only  question  that  can  be  raised 
is  obviously  the  fact  that  we  are  working  with  a  larger  size  of  the  matrix 
(actually  twice  the  size  of  A  matrix  when  A  is  square)  when  using  Lemke's 
method.  The  larger  size  will  definitely  create  problems  of  storage  and  time  of 
computation.  So  further  investigations  were  carried  out  to  see  whether  it  is 
possible  to  work  with  a  reduced  M  matrix  where  M  ■ 

The  first  observation  was  that  the  "nice"  structure  of  the  M  matrix  is 
destroyed  immediately  after  the  first  pivot  when  -e  vector  enters  the  basis 
(refer  to  Figures  1  and  2  of  Section  2).  So  the  first  occurred  idea  was  to  take 
the  -e  vector  to  the  right-hand  side,  perturbate  it  with  the  q  vector  and 
consider  Zq  as  a  "parameter." 

The  second  observation  was  that  if  we  work  with  the  "perturbed"  problem, 
the  "nice"  property  of  M  matrix  (i.e.,  the  two  submatrices  below  and  above  main 
diagonal  are  skew  symmetric)  can  be  retained  by  rearranging  the  columns  such  that 
the  basis  columns  (identity  matrix)  appear  first.  These  observations  led  to  the 
following  modified  algorithm  which  works  only  with  the  reduced  matrix  of  M  which 
results  in  a  greater  saving  in  storage  and  time  and  answers  the  question  raised 
about  the  Lemke  method  at  the  beginning  of  the  section.  We  shall  present  the 
modified  algorithm  completely  independent  of  the  complementary  pivo"  theory. 

But  those  who  are  familiar  with  the  complementary  pivot  theory  can  see  that  it 
is  nothing  but  the  Lemke  method  with  a  slight  modification  in  the  pivot  rule  and 
is  applied  only  to  the  reduced  M  matrix  (viz  the  transpose  of  A  is  never  carried 
in  the  pivots.) 
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A  Complement ary  Pivot  Algorithm 
Consider 


Ax  >  b 
x  >  0 
Min  cx 


where  A  Is  (m  x  n) 


matrix  c  and  x  are  n  vectors  b  is  m  vector 


Let 


A 


}  . 


V  '  m 
yl*  **•’  ym 


V  * 


•  .  v. 


denote  primal  slacks 
denote  dual  variables 
denote  dual  slacks 


the  vectors  u  and 
solution  u1y1  ■  0 
variables).  A*y  x 


y  (>  0)  are  complementary  pair  of  vectors,  i.e.,  in  the 
V  i  -  1,  n  (u^  and  y^  are  called  complementary 

and  v  are  complementary  in  the  sense  xjvj  ^  ^  j  -  1, 


•  t  •  |  n 


Complementary  Rule: 

When  a  variable  leaves  the  basis  bring  the  complement  of  that  variable  into 
basis.  Define: 


•  -ij  :  bi  ■  -bi  v  1  • 

VUJ 


The  basic  variables  are  denoted  by  the  symbol  The  initial  tableau  is  shown  below.. 

The  initial  basis  contains  u, ,  ...,  u  ,v, ,  ...,  v  (primal  slacks  and  dual 

x  n  x  n 
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slacks)  as  basic  variables.  In  the  tableau, 

d  -  1  if  bj  <  0(oob^  >  0) 

•  0  otherwise  i  -  1 . m 

c„+l  ■  •••  "  cn-»  ‘  0 
f±  -  1  if  <  0 

i  ■  1,2,  n,  n  +  1 . n  +  o 

■  0  otherwise  . 
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Let  Z  (1)  -  Max  (M,  ,  Mj 
0  Li 


(4.1) 


Note: 

(4 . 1)  =>  b'  +  Z  (l)d  >  0  and  c,  +  f,Z  (1)  >  0 
10  1“  1  1  o  “ 

If  Z  (1)  <  0  then  terminate.  Now  there  are  two  cases  to  consider.  The 

o  “ 

max  value  Zq(1)  may  occur 

(I)  Corresponding  to  some  j  ■  1,  . n  +  m  . 

(II)  Corresponding  to  pome  1  ■  1,  ...»  m  . 


Case  (1): 

/  ”Cl\ 

ZQ(1)  occurs  corresponding  to  J  ■  1  ^i.e.,  Zq(1)  “  ~f~ j“£>vi  leaves  the 

basis.  (Note :  max-ratio  cannot  occur  corresponding  to  any  nonbasic  "J"  as  their 
fj  “0  .)  Since  a  dual  variable  leaves  the  basis,  we  apply  the  following  dual 
complementary  pivot. 

By  our  compleraen :ary  rule,  the  complementary  variable  (look  up  at  the 

top  row  of  the  tableau  corresponding  to  v^  1)  enters  basis.  (Note  x^  cannot 
replace  v.  . )  By  the  minimum  ratio  rule  find  the  basic  variable  being  replaced 

1  bj  +  zo(i)d1 

by  x^  .  For  this  find  ratios  - ; -  for 

ail 

I 

i  ■  1,  ....  n  and  a^  >  0  .  (4.2) 

Let  the  minimum  of  4.2  occur  corresponding  to  1  ■  m  .  (If  no  such  minimum  exists, 

f 

terminate  as  we  have  an  unbounded  solution  (Ray  Solution)  as  a^  <  0  V  i  .)  So 

from  min  ratio  rule,  we  find  x.  replaces  u  and  y  ,  the  complementary  variable 

l  mm 

of  u^  replaces  v^  from  the  basis. 


Using  a  .  as  pivot  element,  perform  the  pivot  operation.  Note  that  the 
ml 

new  basis  is  shown  again  by  symbol  and  this  concludes  a  dual  complementary 


1 

• 

• 

-ii 

*ml 

0 

•l2 

aln 

• 

• 

1 

m-1 

1  0 

1 

a 9  . 
ml 

u 

am-l,2 

®  « 
m-l,n 

0 

1 

“m2 

a 

m,n 

Cn+1 

Cn+m-l 

Cn+m 

0 

l2 

cn 

*n+l 

^n+tn-1 

^n-Hn 

0 

f2 

f 

n 
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/flm1 

'  cv;i 

-  f  /ii 

vii 


j  ■  2 ,  .  . . ,  n  +  m 


J  m  2  j  ■  •  >  i  n  +  m 
(Note :  -  1) 


(4.3) 


Case  (11): 


Let  max-ratio  4.1  occur  corresponding  to  some  1  -  l~>u^  leaves  the  basis. 
Since  a  primal  variable  leaves  the  basis  due  to  4.1,  we  apply  primal  complementary 
pivot  which  runs  as  follows. 

By  our  complementary  rule,  since  u^  leaves  the  basis  bring  y^  into  basis 
which  replaces  one  of  the  v  's  J  ■  1,  ...,  n.  To  find  the  basic  variable  being 
replaced  by  y^  apply  max-ratio  rule  as  follows:  Form  the  ratios  to  find 


(4.4) 


V  j  ■  1,  ...,  n  and  aj^  <  0 


(As  a  matter  of  fact  this  should  be  carried  out  for  all  elements  of  1st  row 
which  are  <  0  but  in  the  first  pivot  step  we  know  the  first  m  elements  of 
Row  1  are  >  0  .) 

Let  the  max  of  4.4  occur  corresponding  to  variable  v^  .  (If  no  max  exists, 

then  terminate  We  have  an  unbounded  solution  (Ray  Solution  as  all  a^  <  0  V  j  .) 

So  y^  replaces  v^  and  x^  ,  the  complementary  variable  of  vq  ,  replaces 

.  Using  a|n  as  the  pivot  element  perform  the  pivot  operation  ac  <n  Case  (i) 

(Note:  a'  <  0) 

-  m,n 

Step  2: 


With  new  tableau  at  hand,  form  the  ratios  as  in  Step  1  to  find 
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Z 

o 

terminate . 

Theorem  4.1: 

The  new  value  of 
less  than  or  equal  to 

Proof : 

(a)  Consider  first 

* 

and  by  A . 1 , 

and 

To  prove  Z  (2)  <  Z  (1) 
r  o  ■  o 


(2)  -  Max [M,  ,  Mj.  If  Z  (2)  <  0  ,  then 

1  L  O  • 


Z^(2)  (after  a  primal  or  dual  complementary  pivot)  is 
o(1>  • 


Case  (i)  where  we  have  a  dual  complementary  pivot: 


Z  (1) 

o 


(A. 5)  and 


1 


Vi 


Z  (1) 
o 


-cl  -c 


~t  i  f  ■ 
i  j 


(A. 6) 


we  have  to  show 
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M1  ^  Zo(1> 


(A. 7) 


M,  <  Z  (1)  . 
2  ■  o 


(A. 8) 


M  -  Max  — -  V  i 
dt>0  5i 


Note:  4.7  and  4.8  =>  theorem  for  Case  (i).  From  min-ratio  rule  (4.2) 


b’  +  Z  (l)d  b!  +  Z  (l)d 

a  o _ “  <  _ 2 _ k  v  i 

aml  "  ail 


V:  +  TT  bi  +  zo<1)di  v  1 


f ;  - 1  *«) +  z°(1)(d‘ '  4 :  0 


bt  +  Zo(l)d  i  0  by  (4.3) 


—  <  Z  (1)  V  i=t>M,  <  Z  ( 1 )  =>4.7 
-  ■  o  1  ■  o 

di 


M2  -  Max 


V0  L  J. 


Similarly 
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we  will  show 


by  A. 3, 


c,  +  f.  Z  (1)  >  0  (=>4.8) 
J  J  0 


+  fJ2o(1> 


f  /a'  \1 

c4  -  cJ-T1) 

+ 

L J  rJJ 

-  -.(*)] 


Z  (1) 

O 


a 


(c.  +  Z  (l)f  ) 

J  °  J 


>  0 

by  (4.6) 


Jr1-  [c.  +  Z  (l)f  ]  >  0  =>4.8 
‘ml  1  °  1  * 


II 

0 


by  (4.5) 


Hence  after  a  dual  complementary  pivot 


Z  (2)  <  Z  (1) 
o  *  o 


(b)  Now  consider  Case  (ii)  where  we  have  a  primal  complementary  pivot. 


Zo(D 


(4.9) 


and 


~hl 

(4.1)  =>  Z  (1)  >  -77  Vi 

o  ■  d. 

and  Z  (1)  >  — 
o  ■  7 


(4.10) 


V  J  • 
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We  will  first  show: 


M.  <  Z  (1) 
1  ■  o 


i.e. , 


—  <  Z  (1) 
5i  0 


V  i 


b,  +  Z  (l)d  >  0 
i  o  l  ■ 


I-*-  E1  +  Zo(l)3l-  +  Z°a>  dl  -  'lift 


[*•1  +  <*;  zo(1)1  tbi +  zo<1)di1 ; 0 


by  4.10 


by  4.9 


To  show: 


i.e. , 


M.  <  Z  (1) 
1  ■  o 


s2 ;  z„a) 


Q.E.D. 


-1  <  Z  U)  V  1 

h  0 
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By  max-ratio  rule  (4.4) 


fi  * 

•ij 


c  +  z  <l)f 
n  o  _ n 


In 


(Note:  a^n  <  0) 


Note : 


Note  -a^n  >  0  and  >  0 


h +  f3  vi)  i 0 


i.e.,  M2  <  Zq(1) 


Q.E.D. 


Hence  the  theorem  is  proved. 

After  finding  Zq(2)  ,  according  to  the  basic  variable  which  leaves  the 

dual  complementary  pivot  is  done  as  in  Step  1. 


basis  either  primal  or 
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Step  n: 


Z  (n) 
o 


Since  we  did  not  use  any 


special  property  of  first  pivot,  similar  arguments  prove. 


Z  (n)  <  2  (n  -  1' 
o  -  o 


Theorem  4.2: 


Terminate  If  2<)(n)  <  0  ,  and  the  optimal  solutions  of  both  primal  and  dual 
b[n)  and  <4n)  V  i  . 


Proof : 


At  Step  1,  4.1  that 


"1  +  h  zo(1)  ;  0 
c;  +  fj  z0(»  i 0 


V  1 


V  1  . 


At  Step  n  -  1,  the  mln-ratlo  rule  (4.2)  of  the  dual  complementary  pivot.  If  a  dual 
variable  leaves  the  basis  or  the  max-ratio  rule  (4.4,  of  the  primal  complementary 
pivot,  If  a  primal  variable  leaves  the  basis,  guarantees  that 


(n)  +  d(n)  z  (n  -  l)  >  0 


1  o 


(n)  f(n)  z  (n  _  i)  >  0 
i  i  o 


V  1 


V  i 


Also,  we 


have  Z  (n  -  1)  >  o  .  4.1  at  Step  n  gives  Z^fn)  ;  0  and 
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=>  bfn)  +  dfn)  Z  (n)  >  0  Vi 

cfn)  +  f  .(n)  Z  (n)  >  0  Vi. 

1  1  0  * 

So  the  above  must  be  true  for  *11  values  of  Z  between  Z  (n  -  1)  and  Z  (n) 

oo  o 

because  of  linearity.  Note  Zo(n  -  1)  >  0  and  ZQ(n)  <  0  • 

Hence  it  is  true  for  Z  -  0 

o 


«>  bjn)  >0  Vi 


c<«>  >  0 


V  i  . 


Hence  the  solution  we  obtain  by  setting  primal  basic  variables  to 
feasible. 


is 


Claim: 


The  dual  solution  obtained  by  setting 


(n) 

-  c 


n+i 


(n) 

v  ■  c 

J  i 


i  ■  1 . m 

J  ■  1 »  •  •  •  >  n 


is  feasible  for  yA  <  c  ,  y  >  0  which  is  the  dual  L.P.  Problem  to 


Ax  >  b 
x  >  0 
Min  cx  . 


Proof : 


Since 


c»"! ; 0  °  yi 


>  0 


Note  Initially  at  Step  n  ■  0 


0  . 


So  y^’s  can  be  considered  as  multipliers  corresponding  to  the  rows  of  -A 
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matrix  which  gives  cjn^  1  ■  1.  •••.  n  ,  i.e.. 


V  J 


where  is  J  th  column  of  A  .  Since 


p  (°)  _  „ 

J  J 


and 


Cj(n)  >  0 


*c>that  c.  -  ya.  >  0  V  j  or  ya,  <  c.  V  J  =c>  y  la  feasible  for  dual. 

J  J  -  J  -  j 

Q.E.D.  (Claim) 


Note  our  primal  and  dual  complementary  pivot  rule  maintains  the  complementarity 
between  primal  and  dual  variables,  l.e.,  either  y^  or  u^  Is  In  the  basis  but 
not  both.  Similarly  either  or  v^  Is  in  the  basis  but  not  both.  Hence 

the  complementary  slackness  Is  also  satisfied  by  the  primal  and  dual  solution  got 
from  bjn^  and  c^  .  Hence  they  are  optimal  since  by  claim  they  are  feasible. 

Flnlteness  of  the  Algorithm: 

Under  nondegeneracy  assumption  (i.e.,  no  ties  when  forming  max-ratio  or 

mln-ratlo  rule)  Z  (n)  decreases  with  n  (proved  already),  and  since  we  terminate 
o 

when  Z  (n)  <  0  the  algorithm  clearly  ends  in  finite  number  of  steps. 

o  ■ 
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Comments : 

Those  who  are  familiar  with  the  complementary  pivot  theory,  can  easily  see 
that  »n  our  algorithm  we  are  essentially  applying  the  Lemke’s  method  but  to  a 
reduced  tableau,  taking  advantage  of  the  structure  of  M-matrix. 

Dantzig  [1]  has  claimed  that  the  Lemke's  complementary  pivot  method  to  solve 
linear  programs  is  indentical  with  respect  to  the  pivot  steps  to  his  self-dual 
parametric  algorithm  [1].  Though  this  fact  is  not  very  obvious  to  see,  using  our 
algorithm  we  can  see  that  the  pivot  steps  are  identical  to  those  in  the  self-dual 
parametric  algorithm  though  Dantzig  uses  the  idea  of  primal  and  dual  simplex  method 
while  we  make  use  of  the  complementarity  between  the  variables.  Since  our  method 
is  a  condensed  form  of  Lemke's  method  in  some  sense,  we  have  also  shown  that 
Dantzig's  claim  is  true. 


Illustration: 


Consider  the  following  linear  program:  [1] 


Minimize  3x^  -  3x^ 


Subject  to  -2x^  -  2x^  >  -10 


xi  -  x2  ;  1 


-x.  +  2x  >  1 
1  2  ■ 


‘l  •  x2  ■  0 


Using  the  algorithm  of  Section  4,  we  start  with  the  following  initial  tableau. 
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Step  1 


M.  -  Max  {+1,  +1}  -  1 
1  dt>0 

M_  -  Max  { 3  >  —  3 

v° 


Z  (1)  ■  3  and  ->  v_  a  dual  variable  leaves  the  basis.  So  we  apply  dual 
o  2 

complementary  pivot  rule.  The  complementary  virable  (looking  up  the  tableau 
corresponding  to  v^)  x2  enters  the  basis  and  replaces  u2  by  the  min.  ratio 

,  ,  (lO  -1+1 )  _  1  U  A  f  U  A  A  AM  M  1  A  as  AM  +  A  Wtf  «f  A  1*4  A  Wl  A  A  f  11 


rule  as  min  ( -V  ,  —  i  •  1  .  Hence  y„  ,  the  complementary  variable  of  u2 

•is’0'  1 

replaces  v_  from  the  basis.  The  new  tableau  after  the  pivot  operation  is  as 


shown  below 
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Step  3: 


Z  (3)  -  0  terminate  optimal  basis  is  shown  by  *  and  their  values  by  looking 
o 

up  at  the  corresponding  b  and  c  Rows,  i.e., 


*2 

*1 


0 

2 

3 


and 


3 

0 


(Primal  basis) 
The  others 


Xj  •  0 


(Dual  basis) 
The  others 


0 

0 

0 


Minimum  *3.3-  3.2  -9-6  "3 
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